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Ruelle and Selberg zeta functions for 
non-unitary twists 

Polyxeni Spilioti 


Abstract. In this paper, we study the Selberg and Ruelle zeta functions on 
compact hyperbolic odd dimensional manifolds. These zeta functions are dehned on 
one complex variable s in some right half-plane of C. We use the Selberg trace formula 
for arbitrary not neccesarily unitary representations of the fundamental group to 
establish the meromorphic continuation of these zeta functions to the whole complex 
plane. 
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1 Introduction 

The Selberg and Ruelle zeta functions are dynamical zeta functions, which can 
be associated with the geodesic flow on the unit sphere bundle S{X) of a compact 
hyperbolic riemannian manifold X. Namely, they provide information about the 
lenghts of the closed geodesics, also called length spectrum. If we consider the 
geodesic flow 0 on S{X) and d(j) its differential, then 0 has the Anosov property, i.e., 
there exists a d^t-invariant continuous splitting 

TS{X) E^, 

where E^,E'^ consist of vectors that shrink, respectively expand exponentially, and 
E'^ is the one dimensional subspace of vectors tangent to the flow, with respect to 
the riemannian metric, as t —)■ cx). 

These zeta functions can be represented by Euler products, which converge in 
some right half-plane of C. The main goal of this paper is to prove the meromorphic 
continuation of these functions to the whole complex plane. The Ruelle zeta function 
associated with the geodesic flow on the unit sphere bundle of a closed manifold with 
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C'‘^-riemannian metric of negative curvature has been studied by Fried in |Fri95] . It 
is defined by 

fl(o) = 11(1 - 

7 

where 7 runs over all the prime closed geodesics and /(y) denotes the length of 7. In 
|Fri951 Corollary, p.l80], it is proved that it admits a meromorphic continuation to 
the whole complex plane. 

We consider a compact hyperbolic manifold X of odd dimension d, obtained as 
follows. Let G = SO*^(d, 1) and K = SO(d). Then, iC is a maximal compact subgroup 
of G. Let X := G/K. X can be equipped with a G-invariant metric, which is unique 
up to scaling and is of constant negative curvature. If we normalize this metric such 
that it has constant negative curvature — 1 , then X, equipped with this metric, is 
isometric to Let F be a discrete torsion-free subgroup of G such that F\G is 
compact. Then F acts by isometries on X and X = F\X is a compact oriented 
hyperbolic manifold of dimension d. This is a case of a locally symmetric space of 
non-compact type of real rank 1. This means that in the Iwasawa decomposition 
G = KAN, A is a multiplicative torus of dimension 1, i.e., A = M’*'. 

For a given 7 G F we denote by [7] the F-conjugacy class of 7. If 7 7 ^ e, then 
there is a unique closed geodesic associated with [7]. Let /(y) denote the length 
of c^. The conjugacy class [7] is called prime if there exist no k eN with k > 1 and 
7o G F such that 7 = 7 q. The prime geodesics correspond to the prime conjugacy 
classes and are those geodesics that trace out their image exactly once. 

Let M be the centralizer of A in K. We define the zeta functions associated with 
unitary irreducible representations a of M and finite dimensional representations y 
of F. Let y: F —)■ GL(V^) be a finite dimensional representation of F. Let a G M. 
Then the twisted Selberg zeta function Z(s; a, x) is defined by the infinite product 

OD 

Z{s-,a,x)-= JJ JJdet Id-( 7 ( 7 ) ® cr(m^) 0 

k=0 

[7] prime 

where s G C, h is the sum of the negative root spaces of the system (g, a) and 
S'^(Ad(m..ya..y)n) denotes the fc-th symmetric power of the adjoint map Ad{m^a^) 
restricted to h. 

The twisted Ruelle zeta function R{s; a, x) is defined by the infinite product 
R{s-N,x)-= n det(Id-x( 7 ) ® 

[7] prime 
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Both Z(s;cT, x), -R(s;ct, x) converge absolutely and uniformly on compact subsets of 
some half-plane of C. 

In our case, where X = T the dynamical zeta functions are twisted by a 
representation x of F. For unitary representations of F, these zeta functions have 
been studied by Fried f |Fri86] ) and Bunke and Olbrich ( |B095] ). In |Fri86l Theorem 
1], Fried proved that the Ruelle zeta function on a closed oriented hyperbolic mani¬ 
fold associated with an acyclic orthogonal representation of the fundamental group 
admits a meromorphic continuation to the whole complex plane and furthermore the 
absolute value of the Ruelle zeta function evaluated at zero equals the Ray-Singer 
analytic torsion as it is introduced in |RS71] . Apart from the fact that this is of 
great importance, since it provides a connection between the geometry (geodesic 
flow expressed by the Ruelle zeta function) of the manifold and a spectral invariant 
(analytic torsion), the theorem of Fried gave rise to other applications in the held of 
spectral geometry, see for example |MM13] . |Mull2] . In |Mull2] . Muller considered 
the asymptotic behavior of the analytic torsion of a closed hyperbolic 3-manifold 
X, associated with the m-th symmetric power of the standard representation of 
the group SL(2,C). In particular, he proved that for a closed hyperbolic oriented 
3-manifold, 

- log Tx(r,„) = + 0{m), 

An 

as m —>■ cxD t |Mhll21 Theorem 1.1]). In order to prove this theorem, he used the 
expression of the analytic torsion in terms of the Ruelle zeta function attached to 
Tm and based on the results of Wotzke f |Wot08| h In his thesis, Wotzke generalized 
the theorem of Fried to the case of the induced representation r|r of F arising from 
a restriction of a hnite dimensional complex representation r: G —)■ GL(1/) of G. By 
|MM631 Proposition 3.1], there exists an isomorphism between the locally homoge¬ 
nous vector bundle Er over X associated with t\k and the flat vector bundle 
over X associated with r|r. i.e., 

r\{G/K X R) = (F\G X V)/K. 

Once this isomorphism is obtained, a hermitian hber metric in E^ ( |MM63( Lemma 
3.1]) descends to a hber metric in i^gat. Therefore, the Laplace operator associated 
with r|r is a formally self-adjoint operator and the whole harmonic analysis on locally 
symmetric spaces is provided. 

On the other hand, Bunke and Olbrich in |B095| consider a unitary representation 
of the fundamental group for all the cases of compact locally symmetric spaces of 
real rank 1 and of non-compact type, i.e., the compact manifolds whose universal 
coverings are the real, complex, or quaternionic hyperbolic space, or the Cayley plane. 
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Using the Selberg trace formula as main tool for wave operators induced by certain 
Laplace-type and Dirac operators, they proved that the Selberg and Ruelle zeta 
functions admit a meromorphic continuation to the whole complex and furthermore 
satisfy functional equations. 

Our main aim is to generalize the results of Bunke and Olbrich to the case of non¬ 
unitary representations of the fundamental group. Contrary to the setting of Wotzke, 
we can no longer use the results in |MM63] . since we treat the case of an arbitrary 
hnite dimensional representation y: L —)■ GL(V^) of L. Let E-^ be the associated to 
y flat vector bundle over X, equipped with a flat connection V^. In general, there is 
no hermitian metric which is compatible with the flat connection. To overcome 
this problem we use the flat Laplacian, hrst introduced by Muller in |Mulll) . In 
fact, we use a more general operator, the twisted Bochner-Laplace operator dehned 
as follows. 

Let t: K ^ GL(U-) be a complex hnite dimensional unitary representation of 
K. Let Er '.= G XrVr ^ X he the associated homogenous vector bundle over X. 
Let Et- := r\(G X.,- Vt) X he the locally homogenous vector bundle over X. Let 
At- be the Bochner-Laplace operator associated with r. We dehne the operator 
acting on G°°(A, Er G E^). Locally, it can be described as 

A“_^ = A,0ldy^, 


where Aj.^ and A^- are the lifts to X of Aj.^ and A^-, respectively. Our operator 
is not self-adjoint anymore. However, it has the same principal symbol as A^ and 
hence has nice spectral properties, i.e., the spectrum of Aj.^ is a discrete subset of 

a positive cone in C. We consider the corresponding heat semi-group acting 

on the space of smooth sections of the vector bundle E^- ® E^. By IMiillll Lemma 
2.4], it is an integral operator with smooth kernel. Hence, we can consider the trace 
of the operator and derive a corresponding trace formula. 

We already associated the Selberg and Ruelle zeta functions with irreducible 
representations a of M. These representations are chosen precisely to be the rep¬ 
resentations arising from restrictions of representations of K. The keypoint of the 
proof of the meromorphic continuation of the Selberg zeta function is the Selebrg 
trace formula for the operator where Al^(a) is the twisted differential 

operator associated with a & M and induced by A|^^. 
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Theorem 1.1. For every a ^ M we have 

Tr(e-i4(-)) =dim(l^^)Vol(X) [ P^{i\)d\ 

Jr 


+ 5 : 


^(7) 

^r(7) 



(7; 4 


(47rt)72 ’ 


where 


det(Id — Ad{m^a^))n 


Our main results are stated in the following theorems. 


Theorem 1.2. The Selberg zeta function Z(s; a, x) admits a meromorphic continua¬ 
tion to the whole complex plane C. The set of the singularities eguals = dii^,/tk : 
tk G spec(yl^((T)),/c G N}. The orders of the singularities are egual to m(tk), where 
m{tk) G N denotes the algebraic multiplicity of the eigenvalue tk- For to = 0, the 
order of the singularity sq is egual to 2m(0). 

Theorem 1.3. For every a G M, the Ruelle zeta function i?(s; a, x) admits a mero¬ 
morphic continuation to the whole complex plane C. 

As it is mentioned before, the operator is induced by the twisted Bochner- 

Laplace operator and therefore has similar nice spectral properties, i.e., its spectrum 
is discrete an contained in a translate of a positive cone in C. By Theorem 1.2, we 
observe that the singularities of the Selberg zeta function are located precisely at 
the points tk-, which belong to the discrete spectrum of the twisted operator 
Hence, this theorem provides an interesting relation between the dynamics of hyper¬ 
bolic manifolds and the spectral theory of the twisted Bochner-Laplace operators. 

Basic notions and facts from representation theory and the theory of locally 
symmetric spaces are presented in section 2. In section 3, we introduce the Selberg 
and Ruelle zeta functions associated with the geodesic flow of a compact hyperbolic 
manifold and prove that they converge in some right half-plane of C for an arbitrary 
hnite dimensional representation of B. Section 4 is devoted to the study of the twisted 
Bochner-Laplace operator on a compact hyperbolic odd dimensional manifold X and 
its spectral properties. Next, in section 5, we obtain a trace formula for the heat 
operator, induced by specihc twisted Bochner-Laplace operators. Finally, in section 
6, we provide the proof of the meromorphic continuation of the dynamical zeta 
functions to the whole complex plane, as it is stated in Theorems 1.2 and 1.3. 

Acknowledgement. The present paper is part of the author’s PhD thesis and 
therefore she is grateful to her supervisor, Werner Muller, for his helpful suggestions, 
remarks and advices. 
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2 Preliminaries 


A special case of a locally symmetric space of real rank 1 is a compact hyperbolic 
locally symmetric manifold with universal covering the real hyperbolic space 

= {{xi,...,Xd+i) e :xl-xl... = l,xi> 0}, 

where d = 2n + 1, and n G N>o is an odd integer. We consider the universal 
coverings G = Spin((i, 1) of SO°((i, 1 ) and K = Spin((i) of SO((i), respectively. We 
set X := G/K. Let 0 , { be the Lie algebras of G and iL, respectively. Let g = { © p 
be the Cartan decomposition of 0 . We denote by 0 the Cartan involution of G and 
Q be the differential of 0 at = e, which is the identity element of G. Let a be 
a Cartan subalgebra of p, i.e., a maximal abelian subalgebra of p. There exists a 
canonical isomorphism T^k — P- We consider the subgroup A of G with Lie algebra 
a. Let M := Centrx(A) be the centralizer of A in K. Then, M = Spin((i — 1) or 
M = SO{d — 1). Let m be its Lie algebra and b a Cartan subalgebra of m. Let 
p be a Cartan subalgebra of 0 . We consider the complexihcations 0 c := 0 © i 0 , 
pc := P © *P and me := m © im. Let B{X, Y) be the Killing form on 0 x 0 dehned 
by B{X, Y) = Tr(ad(X) o ad(K)). It is a symmetric bilinear from. We consider the 
inner product 

{Y,,Y2)o:=^^^^B{Y^,Y,), Ki,K 2 e 0 , ( 2 . 1 ) 

induced by the Killing form. The restriction of {■,-)o to p dehnes an inner product 
on p and hence induces a G-invariant riemannian metric on X, which has constant 
curvature —1. Then, X, equipped with this metric, is isometric to EI'^. Let T C G 
be a lattice, i.e., a discrete subgroup of G such that Vol(r\G) < cx). T acts properly 
discontinuously on X and X := r\X is a locally symmetric space of hnite volume. 
We assume that T is torsion free, i.e., there exists no 7 G T with 7 7 ^ e such that 
for /c = 2, 3,..., 7 ^ = e. Then, X is a locally symmetric manifold. If in addition 
T is cocompact, then X is a locally symmetric compact hyperbolic manifold of odd 
dimension d. 

Let G = KAN be the standard Iwasawa decomposition of G. Let A+( 0 , a) be the 
set of positive roots of the system ( 0 , a). Then, A’''( 0 , a) = {a}. Let M' = Normii-(A) 
be the normalizer of A in K. We dehne the restricted Weyl group as the quotient 
Wa ■= M'/M. Then, Wa has order 2. Let w G Wa be a non-trivial element of Wa-, 
and rriu] a representative of w in M'. The action of Wa on M is dehned by 

{wa){m) := m & M,a & M. 
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Let G a such that a{H^) = 1. With respect to the inner product (2.1), has 
norm 1. We dehne 

A'^ := {exp(tiL]R): t G M’*'}. (2.2) 

We dehne also 

P-=\ dim(0c^)a, (2.3) 

«SA+( 0 ,a) 

Pm := ^ "• 

aeA+(mc,b) 


The inclusion i\ M ^ K induces the restriction map i* \ R{K) —)■ R{M), where 
R{K),R{M) are the representation rings over Z of iL and M, respectively. Let 
K, M be the sets of equivalent classes of irreducible unitary representations of K 
and M, respectively. Then, for the highest weight of r G iL we have 

Vr = (z/i,...,!/^), 

where I'l > ■ ■ ■ > I'n and z/j, i = 1,..., n are all integers or all half integers (that is 
Vi = qi/2,qi G Z) and for the highest weight of a G M, 

= {vi,. . . ,Vn-l,Vn), (2.5) 

where vi > ... > z/„_i >\vn\ and z/*, i = 1,..., n are all integers or all half integers 
(see |B0951 p. 20]). Let s be the spin representation of K, given by 

s: K ^ End(A 2 n) © End(A 2 n) ^ End(A 2 n) 

where A 2 n ■= such that n = k, and pr denotes the projection onto the first 
component f |Fri001 p.l4]). We set for abbreviation S = A 2 n- Let {s~, S~) 

be the half spin representations of M, where := A^ ( |Fri00| p.22]). The highest 
weight of s is given by Vg = (4,..., 1), and the highest weights of are Vs+ = 

(4,..., 1), Ug- = (!,..., -1), respectively (|B095t p. 20]). 

We consider now the parametrization of the principal series representation. Let 
P = MAN be the standard parabolic subgroup of G. For (a, W) ^ dT, we dehne 
the space Tfo- of continuous functions on G by 

hfo- := {/: G —t 14 : f{gman) = G G,\/man G P}, 
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where A G C and p as in (2.3), with norm 


ii/iic= [ wmrdk. 

Jk 


( 2 . 6 ) 


We define the principal series representation as the indnced representation 


TT^^x ■= Indp((T ® ® Id), 


with representation space the Hilbert space, obtained by completion of with 
respect to the norm H-Hc in (2.6). For / G fifo-, the action of G on / is given by 
= f{g~^g')- space of the linear fnnctionals on ac- In the 

definition of the space fifo-, A is a complex nnmber. Hence, is identified with C, 
nsing the positive root. If A G M, then the representation 7ro-,A is nnitary. In addition, 
ifAGM — {0}, then tTo-.a is irredncible. 

Let ppL{'^a,\) be the Plancherel measnre, viewed as a measnre on the set of the 
principal series represenations na,x- Since rank(G) > rank(iF), by classical result of 
Harish-Chandra f |HC66) L the set of the discrete series representations of G is empty. 
Then, by |Kna86( Theorem 13.2], 

dppLi'n'a^) = P„{i\)dX. 


Here, Pa{i\) is the Plancherel polynomial given by 


F<x(^A) 


n 

aeA+( 0 c,f)) 


{i\ + v„ + Pm, a) 

(Pg, Q) 


where (■, •) is the inner product on a*, is the highest weight of a as in (2.5), pm is 
defined as in (2.4), and pg is defined by 



aeA+(0c,h) 


(see |B095l p.46]). Let z = iA G C. Then, by |Mia79l p.264-265], Pa{z) is an even 
polynomial of z, and hence Pa{,z) = P„{—z). 











3 Twisted Selberg and Ruelle zeta functions 

We consider the twisted Ruelle and Selberg zeta functions associated with the 
geodesic flow on the sphere vector bundle S{X) of X = r\G/K. Since K acts 
transitively on the unit vectors of p, by the adjoint representation, S{X) can be 
represented by the homogenous space G/M. Therefore, S{X) = T\G/M. 

We recall the Cartan decomposition G = KA^K of G, where is as in (2.1). 
Then, every element g & G can be written as g = ha+k, where h,k & K and a+ = 
exp{tH]s) for some t G M"*". The positive real number t equals t = d{eK, gK), where 
d denotes the geodesic distance on X. It is a well known fact (jGKMM]) that there 
is a 1-1 correspondence between the closed geodesics on a manifold X with negative 
sectional curvature and the non-trivial conjugacy classes of the fundamental group 
7 ri(X) of X. The hyperbolic elements of T can be realized as the semisimple elements 
of this group, i.e., the diagonalizable elements of T. Since T is a cocompact subgroup 
of G, we realize every element 7 G T — {e} as hyperbolic. We denote by the closed 
geodesic on X, associated with the hyperbolic conjugacy class [ 7 ]. We denote also 
by /(y) the length of c^. Since T is torsion-free, /(y) is always positive and therefore 
we can obtain an inhmum for the length spectrum spec(r) := {/(y) : y G T}. An 
element y G T is called primitive if there exists no n G N with n > 1 and yo G T such 
that y = 70 . We associate to a primitive element yo G T a prime geodesic on X. 
The prime geodesics correspond to the periodic orbits of minimal length. Hence, if 
a hyperbolic element y in T is generated by a primitive element yo, then there exists 
a nr(y) G N such that y = The corresponding closed geodesic is of length 

l(j) = nr(y)/(yo). 

We lift now the closed geodesic to the universal covering X. For y G T, 
/(y) := inf{d(a;, yx) : x G X}, and /(y) = inf {d{eK, g~^'jgK) : g G G}. Hence, we 
see that the length of the closed geodesic /(y) depends only on y G T. Let y G T, 
with y 7 ^ e and y hyperbolic. Then, by |Wal761 Lemma 6.5] there exist a g E G, a 
m.y G M, and an G A+, such that g~^'yg = m^a^. The element is determined 
up to conjugacy classes in M, and the element depends only on y. 

Analogous to the consideration of |B0951 Section 3.1], we dehne the geodesic flow 
(j) on S{X) by the map 

0: M X ^(X) 9 (tAgM) -E Tgexp{-tH^)M G ^(X). 

A closed orbit of cj) is described by the set c := {Tg exp{—tH]^)M: t G M}, where 
g E G is such that g~^'^g := E MA^. 

The Anosov property of the geodesic flow 0 on S{X) can be expressed by the 
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following (i0-invariant splitting of TS{X) 

TS{X) = T^S{X) © rS{X) © T^S{X), (3.1) 

where T‘^S{X) consist of vectors that shrink exponentially, T“5'(X) expand expo¬ 
nentially, and T'^5'(X) is the one dimensional subspace of vectors tangent to the flow, 
with respect to the riemannian metric, as f —)■ cx). The spitting in (3.1), corresponds 
to splitting 

T^(X) = r\G XAd (h©a©n), (3.2) 

where Ad denotes the adjoint action of Ad{exp{—tH^)) on h, a, n, and h = 6'n is the 
sum of the negative root spaces of the system (g, a). 

Let {a, V^) G M and (y, V^) be a finite dimensional representation of T. Let 
E{a, x) ■= r\(G Xo-ig,^ (1A©L^)) —)■ S{X) be the vector bundle over S{X), associated 
to the representations a and y. The action of M and T on G x (lA ® V'y) is defined 
by 


[g, n © w] = {{X9i cr{m)v © y(7)tc): S' G G, n G 14, tc G 1^, 7 G T, m G M}, 

We can lift the flow ip to the flow ipcr,x -^(© x) by the map 

0^,^: M X E{a,x) 3 (4 [ 9 ,v(^w]) [g exp{-tHM.),v w ] G E{a,x)- 

Definition 3.1. Let y: T —)■ GL(14) be a finite dimensional representation of T and 
a G M. The twisted Selberg zeta function ©(s; a, y) for X is defined by the infinite 
product 

OO 

Z{s-(j,x) := n ® 

W^e A:=0 
[7] prime 

(3,3) 

where s G C, n = 6*n is the sum of the negative root spaces of a, S'^(Ad(m^a^)n) 
denotes the k-ih. symmetric power of the adjoint map Ad(m..ya.y) restricted to h, and 
p is as in (2.3). 

Definition 3.2. Let y: T —)■ GL(14) be a hnite dimensional representation of T and 
a G M. The twisted Ruelle zeta function R{s] a, y) for X is defined by the infinite 
product 

R{s]a,x)-= n det (Id-y( 7 ) . (3.4) 

[7] prime 
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In order to prove the convergence of the zeta functions, we need to hnd an upper 
bound for the character of any hnite dimensional representation of F. 

Lemma 3.3. Let y: F —)■ GL(V^) be a finite dimensional representation o/F. Then, 
there exist positive constants K,k > 0 such that 

Mx{l))\<Ke^'^^\ V 7 GF-{e}. (3.5) 

Proof. We £x a hnite set of generators L = { 71 ,..., 7 ^} of F and choose a norm ||-1| 
on V^. Let dw{-, ■) be the word metric on F (see |LMRnn] for further details). Let 
Iwil) = dwil, e) be the length of 7 G F with respect to this metric. Then, if we put 
C = max{||x( 7 i)|| : 7 * G L U we get for c = logG, 

||7(7)|| (3.6) 

By |LMR00l Prop. 3.2], it follows that there exist positive constants ci,C 2 > 0 such 
that 

Cid{xo,'yxo) < dwie,^) < C2d{xo,'yxo), (3.7) 

where xq := eK is the identity element of X. Then, (3.6) becomes by (3.7) 

It follows that 

|trx( 7 )| < dim( 14 )||x( 7 )|| < (3.8) 

Now by dehnition, 

/(y) := min{d(a;, 7 x) : x G X}. 

We choose a fundamental domain F G X for F such that Xq G F. Given 7 G F, 
let Xi be in X, such that /(y) = d^xi^^Xi). Then, there exists a 71 G F such that 
xi G 7iF. Let X2 E F such that xi = 710:2 • By compactness of the fundamental 
domain, diam(F) is hnite. If we put 6 := diam(F), then 


d{xo,X2) < S. 


(3.9) 


We see that 


d{xo, 7 i ^71^0) < d{xo, X2) + d{x 2 , 7 i ^713^0) 

<6 + d { x 2 , 77^7710:0). (3.10) 
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In addition, 


< d{x2,Ji^jjiX2) + d(7r^77ia^2,7rS7ia^o) 

< d{x2, 7rS7ia^2) + d{xo, X 2 ) 

< d{x2, 7 rS 7 ia^ 2 ) + d. (3.11) 

Hence, by (3.10) and (3.11) we get 

d(xo,7r^77i^o) <2d + d(a;2,7fS7ia^2)- 

Recall that xi = 71 X 2 . Therefore, we have 

d(a;o,7rS7ia^o) < 25 + d(j^^xi,j^^jxi) 

< 2d + dlxijjxi). (3-12) 

Using (3.8) and (3.12) we obtain the following inequalities. 

|tr(x(7))l = |tr(x(7rS7i))l 

<; (y^^C2d(xo,'y^^j7ixo) 

< (y^^‘^2(2S+d(xujxi)) 

— (y^^C2d(xi,jxi) _ (7_^gC277)_ 

The assertion follows. □ 

We are ready now to prove the convergence of the Selberg and Ruelle zeta func¬ 

tions. 

Proposition 3.4. Let y: T —)■ GL(V^) be a finite dimensional representation of T 
and a G M. Then, there exists a constant c > 0 such that 

00 

Zis;a,x)-= JJ JJdet(l-(y( 7 )( 8 )a(m.^)( 8 ) 5 '''(Ad(m^a^)^^))e"(^+l'’l)'('^)), (3.13) 

H^e fc=0 

[ 7 ] prime 

converges absolutely and uniformly on compact subsets of the half-plane Re(s) > c. 
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Proof. We observe that 


logZ(s;a,x)= X]trlog(l - (x(7) ® ® 

tr((x( 7 ) ® cr(m^) 0 


H^e A:=0 
[ 7 ] prime 


00 00 


- E EE 

[7]/e ^=0 j=l 

[ 7 ] prime 

00 ^ 

- —^tr(x(7) ^a{m.y) ® 
’^rt7J 


fc =0 


1 p-(s+|p|)h7) 

Y1 WZA t’^(x(7) ® ^^("^ 7 )): 


hl^e 


nr ( 7 ) 


det(Id — Ad(m^a-y)n) ’ 


(3^14) 


where in the last equation we made use of the identity 


S^(Ad(mja.y)n) 

k=0 


1 

det(Id — Ad(m-ya-^)n 


Initially, we observe that 

|tr(T(m^)| < dim((T), Vcr G M. 


We need an upper bound for the growth of the length spectrum /(y). Using the 
normalization of the Haar measure on G as in |Wal73| Proposition 7.6.4] we see that 
there exists a positive constant C > 0 such that for every i? > 0 

Vol(5(a;o,i?)) < 


where p as in (2.3). Since P is a cocompact lattice of G, there exists a positive 
constant C such that 


tt{[7] : /(7) < i?} < tt{7 e P : /(y) < R} < (3.15) 

We need also an upper bound for the quantity 

1 

det(Id — Ad{m.ya.y)n) 
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Since det(Ad(a^)^Y) = exp(— 2 |p|/( 7 )) we can use the estimates (3.15) to see that we 
can consider a [ymin] among all the conjugacy classes of F, such that li'ymin) is of 
minimum length. Hence, there exists a positive constant C” > 0 such that 


det(Id — Ad(m^a..y)n) 

By Lemma 3.3, it follows that there exist positive constants C, ci > 0 such that 


E 


1 

nr ( 7 ) 


tr(x(7)(8)a(m^)) 


e-(s+|p|)h7) 

det(Id — Ad{m^a^)n) 


< 



g(ci-Re(s))77) 




00 

= g(ci-Re(s))77) 

k=0 [7]^e 


k=0 


where 

K(/2):=«{[7]er:/(7)<i?}, R > 0. 

By (3.15), we have 


00 


00 


k=0 


<c'Y 


g(2|p|+ci-Re(s))fc 


k=0 


Hence, there exists a positive constant c > 0 such that for s G C with Re(s) > c. 


E 


1 

nr ( 7 ) 


tr(x(7) 0a(m^)) 


g-h+|p|)h7) 

det(Id — Ad(m.ya.y)n) 


< CX). 


The assertion follows form (3.14). □ 

A similar approach will be used to establish the convergence of the Ruelle zeta 
function. 
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Proposition 3.5. Let F —)■ GL(V^) be a finite dimensional representation of T 
and a & M. Then, there exists a constant r > 0 such that 

R{s;(t,x)-.= JJ det (Id-x(7) ® • (3-16) 

[7] prime 


converges absolutely and uniformly on compact subsets of the half-plane Re(s) > r. 
Proof. We observe that 


logR(s;a,x) =(-1)"' ^ trlog(l - x(7) ® 

tr((x(7) ® a{m-f)e~^'-^'^^y) 


[7] prime 


(-It Z E 

ii]*c j-i ■' 

[7] prime 

(-It E ;^f(x(7) (3,17) 




By Lemma 3.3, it follows that there exist positive constants G, ci > 0 such that 
1 


E 


^r(7) 


tr(x(7)(g)(T(m^))e 

(ci-Re(s))Z(7) 


<G^e' 


CE E J^(*:+l)< 


,(ci-Re(s))Z(7) 


k=0 [7]^e 

k<l('y)<k+l 


< G^K(A; + l)( 


(ci—Re(s))A: 


fc =0 


By (3.15), we have 




,(2|p|+ci—Re(s))fc 


k=0 


k=0 
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Hence, there exists a positive constant r > 0 such that for s G C with Re(s) > r, 


^ nr( 7 ) 


h]9^e 


< 00 . 


The assertion follows form (3.17). 
Lemma 3.6. ITe set 

-^sym('yj^) ■ 


ti’(x( 7 ) ® cr(m^))e 


(3.18) 


□ 


(3.19) 


det (Id — Ad(mya^)n) 

Then, the logarithmic derivative of the Selberg zeta function Z(s;a,x) is given by 


L{s) := ^\og{Z{s;a,x)) = -^^j^Lsymix; (T)e 


Proof. We see by equation (3.14) 




(3.20) 


d . .ry, ,, Ih) / / X /XX e ^h7)g |plh7) 

log(Z(s; a, x)) = 2 ^ 777 ^ tr(x(7) ® ^^("^ 7 )); 


ds 




^r(7) 


det(l — Ad(m.ya.y)n) 


V L h- 


hlT^e 


□ 


4 The twisted Bochner-Laplace operator 

Let E X he a complex vector bundle with covariant derivative V. We dehne 
the second covariant derivative by 

^V,W VyVw — XyLCyy, 

where V, W G C°°{X,TX) and denotes the Levi-Civita connection on TX. We 
dehne the connection Laplacian Ae to be the negative of the trace of the second 
covariant derivative, i.e., 

Ae := -TrVh 
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By |LM89l p.l54], the connection Laplacian is equal to the Bocner-Laplace operator, 

i.e. 

Ae = V*V. 

In terms of a local orthonormal frame field {ei, ... ,ed) of T^X, for x & X, the 
connection Laplacian is given by 

d 

i=i 

A^: C°°{X,E) O is a second order differential operator. Let h be a metric in E. 
Then, Ae acts in L‘^{X,E) with domain C°°{X, E). Since the principal symbol of 
Ae is computed to be o'Ab(x,^) = ||'C||^Id^^, we can conclude that Ae is an elliptic 
operator and hence it has nice spectral properties. Namely, its spectrum is discrete 
and contained in a translate of a positive cone C C C such that M"*" C C ( |Shu87| 
Theorem 8.4 and Theorem 9.3]). Furthermore, if the metric is compatible with the 
connection V, Ag is formally self-adjoint. 

Let y: T —GL(V^) be an arbitrary representation y: T —GL(V^) of T. Let 
Ey. ^ X he the associated flat vector bundle over X, equipped with a flat connection 

We specialize now to the twisted case E = Eq® E^, where X is a complex 

vector bundle equipped with a connection and a metric, which is compatible 
with this connection. Let V® = the product-connection, defined by 

;= (g) 1 -Fl (g) 

We define the operator A^^ ^ by 

= (4.1) 

We choose a hermitian metric in E^. Then, A^^ ^ acts on L‘^{X, Eq g) E^). However, 
it is not a formally self-adjoint operator in general. We want to describe this operator 
locally. Following the analysis in |Mulll| . we consider an open subset U of X such 
that E^\u is trivial. Then, Eq® E^\u is isomorphic to the direct sum of m-copies of 
EqIu, i.e., 

{Eo ® E^)\u= (B'^iEqIu, 

where m := rank(F^^) = dimLet (ej),i = 1, • ■ ■ ,m be a basis of flat sections of 
^xlu- TliGii, g3jc1i (j) ^ (-^0 ^ written ns 

m 

0 = G ej, 

i=l 
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where 0, G C°°{U, EQ\u),i = 1,... ,m. The product connection is given by 


i=l 


where Y e C’^{X,TX). 

By (4.1) we obtain the twisted Bochner-Laplace operator acting on C°°{X, Eq^E^), 
defined by 

m 

® ei, (4.2) 

where denotes the Bochner-Laplace operator A'®° = (V^°)*V®“ associated to 
the connection V'^°. Let now Eq,E^ be the pullbacks to X of Eo,E^, respectively. 
Then, ^ ^ 

E^ = XxV^, 

and 

C{X,Eo®E^)=C{X,Eo)®V^. (4.3) 

With respect to the isomorphism (4.3), it follows from (4.2) that the lift of A^,^ ^ to 
X takes the form 

'^Eo,X ~ ® (^•^) 

where A^;^ is the lift of A^^ to A. By (4.2), A^^ ^ has principal symbol 






xe A,eeT:A,e^0. 


Hence, since the principal symbol is self-adjoint with respect to the fiber metrics on 
Ex and Eq, it has nice spectral properties, i.e., its spectrum is discrete and contained 
in a translate of a positive cone C* C C such that C C ( |Shu87[ Theorem 8.4 
and Theorem 9.3]). We include here some definitions, which are needed to study the 
spectrum of the twisted Laplace-Bochner operator. For further details see |BKn8l 
p.203-206]. 

Definition 4.1. A spectral cut is a ray 


Re := {pe*® : p G [0, cx)]}. 


where 6^ G [0, 27r). 

Definition 4.2. The angle 0 is a principal angle for the elliptic operator A^^ ^ if 
spec(crA(a:, 0) H = 0, Va: G X, G T^X, ^ ^ 0. 
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Definition 4.3. We define the solid angle L/ associated with a closed interval / of 
M by 

L/:={pe*^pe (O,oo),0e/}. 

Definition 4.4. The angle 9 is an Agnion angle for an elliptic operator if it 

is a principal angle for D and there exists £ > 0 such that 

spec(A) n L\e-e,e+e\ = 0- 

Lemma 4.5. Let e G (0, |) he an angle such that the principal symbol {^,0 

Eq,x 

o/A^^ for ^ G TfX,^ 7 ^ 0 does not take values in Then, the spectrum 

spec(A^^^) of the operator A^^ ^ is discrete and for every e G (0, |) there exist 
R > 0 such that spec(A^^ is contained in the set B(0, R) U C C. 

Proof. The discreteness of the spectrum follows from |Shu87t Theorem 8.4]. For the 
second statement see |Shu87l Theorem 9.3]. □ 

Let Afc be an eigenvalue of A^^ ^ and Vx^. be the corresponding eigenspace. This 
is a finite dimensional subspace of C°°{X,E) invariant under D. For every fc G N, 
there exist Nk eN such that 

(Akx-^ndy‘n. = o 

lim |Afc| = oo. 

k^oo 

By |Mar88] . the space T^(A, E) can be decomposed as 

L7V.i5) = 0n.. 

k>l 

This is the generalization of the eigenspace decomposition of a self-adjoint operator. 
We note here that in general the above decomposition is not a sum of mutually 
orthogonal subspaces (see |Mnllll p. 7]). 

Definition 4.6. We call algebraic multiplicity m(Afc) of the eigenvalue Xk the di¬ 
mension of the corresponding eigenspace Vxf.- 

_ f/\^ 

We want to define the heat operator e ^O’X associated to the twisted Bochner- 
Laplace operator. Let 9 be an Agmon angle for the operator A^^ Then, by 
definition of the Agmon angle and Lemma 4.5, there exists £ > 0 such that 

spec(Ai 5 ^^^) n = 0. 
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Since ^ has discrete spectrum, there exists also an ro > 0 such that 

spec(A^^_^) n { 2 ; e C : |z + 1| < 2ro} = 0. 

We define a contour as follows. 

re,ro = riU r2ur3, 

where Fi = { — 1 + re*^: 00 > r > tq}, F2 = {—1 + roe“: 6 < a < 6 + 27 r}, 
F3 = { — 1 + tq < r < cx)}. On Fi, r runs from 00 to tq, F2 is oriented 

counterclockwise, and on F3, r runs from Tq to cxd. We put 

= ^ / ^ ( 4 - 5 ) 

^ ^6,rQ 

By |Shn87[ Corollary 9.2] and the fact that \e~^^\ < the integral in equation 

(4.5) is well defined. 


5 Trace Formulas 


We want now to define a more special case of a twisted Bochner-Laplace operator. 
Namely, we conisder the operator A|^ acting on C°°{X,Et- ® E^), where E^ is 
the locally associated homogenous vector bundle associated with a complex finite 
dimensional unitary representaion (r, W) of K. 

The keypoint is that, when we consider the lift of the twisted Bochner-Laplace 
operator to the universal covering, this operator acts as the identity operator on the 
space of the smooth sections of the fiat vector bundle E^. Recall that by formula 
(4.4), we get 

Af.^^ = Ar<^ Idv^, 

where A,- is the lift to X of the Bochner-Laplace operator A,-, associated with the 
representation r of iF. 

We give here an explicit description of the operator A,-. We regard the Lie group 
G as principal iF-fiber bundle over X. Let vr: G —)• G/K be the canonical projection. 
Then, since p is invariant under the adjoint action Ad(fc), k E K, the assignment 



d 

dt 


gexp{tX), 

t=o 


A e p 


defines a horizontal distribution on G f |KN961 Chapter III]). This is the canonical 
connection in the principal bundle G. Let t ■. K ^ GL(W) be a complex finite 
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dimensional unitary representation of ii' on a vector space 14 , equipped with an 
inner product (•, ■ )r- Let Er be the homogenous vector bundle associated with 
(r, 14 ), dehned by 

Er := G XrVr^X, 
where K acts on (G, I 4 ) on the right by 

{g,v)k = {gk,T~^{k)v), g e G, k e K,v e Vr. 

The inner product • )r on the vector space I 4 induces a G-invariant metric on 
Er- We denote by G°°(X, Er) the space of the smooth sections of the vector bundle 
Er- We dehne the space 

G“=(G;r) = {/ : G ^ W: / e G^Jigk) = r(A;)-V.? G G,Vfc G K}. (5.1) 

Similarly, we denote by G4(G;r) the subspace of G°°(G;r) of compactly supported 
functions and L‘^{G] r) the completion of G“(G; r) with respect to the inner product 


(/,^)= [ {f{9),h{9))Tdg. 

Jg/k 

Let A: G°°{X,Er) — t G°°{G;t) be the operator, dehned by 

Af{g) = g-^f{gK). 


Then, the canonical connection on Er is given by 




d 

dt 

dt 


^/(^exp(fX)) 

t=o 

(gexp(tX))-^f(gexp(tX)K), 

t=o 


where G G,X G p, and / G G°°{X,Er). By |Mia801 p. 4], A induces a canonical 
isomorphism 

G~(X,E4 ^G“(G;r). (5.2) 

Similarly, there exist the following isomorphisms 

G4(X,E4 = G4(G;r); (5.3) 

L\X,Er) = L\G;T). 
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We consider the Bochner-Laplace operator associated with 

A, = (V")*V" : C^{X,Er) ^ L\X,Er). 

Let now G Z[qc) be the Casimir element of G. We assnme that r is irredncible. Let 
fflic G Z{1) be the Casimir element of K and the associated Casimir eigenvalne, 
where Z{1) denotes the center of L Then, with respect to the isomorphism (5.2), the 
Bochner-Laplace operator acting on C'“(G;r) is given by 

Xr = -R{yt) + Kl<l. (5.4) 

This is proved in |Mia8n( Proposition 1.1]. The operator is an elliptic formally 
self-adjoint differential operator of second order. By |Che73) . it is an essentially self- 
adjoint operator. Its self-adjoint extension will be also denoted by A,-. 

We consider the corresponding heat semi-gronp acting on the space L^(X, E^-). 

g-tW . 2,2 (X, Er) L\X, Er). 

By [CYMl p.467], > 0 is an infinitely smoothing operator with a C'°°-kernel, 

i.e. there exists a smooth fnnction kj: G x G ^ End(Vj-) snch that 

1. it is symmetric in the G-variables and for each g & G, the map g' h->■ kl{g,g') 
belongs to L‘^{X,Et-)] 

2. it satisfies the covariance property, 

Kiak^g'k') = T-\k)kl{g,g')T{k'), \/g,g' G G,k,k' G iC; 

3. for / G L2(x,E,), 

e“*^"/(^) = [ kl{g,g')f{g')dg'. (5.5) 

Jg 

The Casimir element is invariant nnder the action of G. Hence, A.^ is G-invariant, and 
is an integral operator which commntes with the right regnlar representation 
of G in L‘^{X, Et-). Then there exists a fnnction : G —?■ End(W); snch that 

Hl{g-^g') = kl{g,g'), \/g,g'eG; 

2. it satisfies the covariance property 

H^{kgk')=T-\k)Hlig)Tik'), Mg G G,Vfc,fc' G W; (5.6) 
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3. for / e L^X,E^), 


= [ H;{g-'g')f{g')dg'. 
Jg 


(5.7) 


We denote by (C'^(G) (8)End(W))'^^^ the Harish-Chandra L'^-Schwartz space of func¬ 
tions on G with values in End(W); dehned as in |BM83t p.161-162], such that the 
covariance property (5.6) is satished. 

Theorem 5.1. Let t > 0. Then, for every g > 0 

HI e (e'?(G) 0 End(V;))^^^. 

Proof. This is proved in |BM83( Proposition 2.4], □ 

In |BM83l p.l61], it is proved that 




= RriHf), 


where Rr{Hf) denotes the bounded trace class operator, induced by the right regular 
representaion of G, acting on G°°{G] r). It is decribed by the formula 


= / H;{g-'g'}f{g')dg'. 

JG 

More generally, we consider a unitary admissible representation vr of G in a Hilbert 
space TCtt. We set 

[ Ti{g)® Hl{g)dg. 

Jg 

This dehnes a bounded trace class operator on IK^r <8) W- By |BM831 p.160-161], 
relative to the splitting 

‘K,®Vr = (IK, ® © [(©:, © 

n{Hl) has the form 

^(h;) = . (5.8) 

with TT{Hf) acting on (IK, ® Then, it follows that 

= vr(i7;), (5.9) 
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where Id denotes the identity on the space {“Kt, ® f |BM83l Corollary 2.2]). We 
let 

htia) ■= 

We consider orthonornial bases {^n),n ^ = I,-'' of fho vector spaces 

'K^,Vr, respectively, where k := dim(W)- By (5.8), 

TriniHl)) = Tt^H;)). (5.10) 

We have 

Tr(^(i/;)) = ® e^), (^^ ® ej)) 

n j 

= YY 1 [ (^i9)^n,^n){H;{g)ej,ej)dg 

n j 9G 

= Y f (^i9)^n,^n)hl{g)dg 

n 9G 

= 5^(7r(hi)^n,Cn) 

n 

= Tin{h:). (5.11) 

Hence, if we combine equations (5.9), (5.10) and (5.11), we get 

Tr 7r(h[) = dim(:K^ 0 W)^- (5.12) 


Now we want to specify the unitary representation vr of G. We consider the unitary 
principal series representation 7i'a,x, defined in section 2. Our goal is to compute the 
Fourier transform of h^, 

Qa,x{hl) = Tiw^^xihl). 

Proposition 5.2. For a ^ M and A G M, let Qa,x be the global character of 
Let T G K. Then, 

QaAhl) = (5.13) 


Proof. We have 

Q^Aht) = ® W)^ = : f], 

where f denotes the contragredient representation of r. We have 

e^AK) : f] 
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In the last line in the equation above we use the Frobenius reciprocity principle, 
which is described for compact Lie groups in ( |Kna861 Theorem 1.14]). By ( |Kna861 
p.208]), one has 


■'r]= ^ riu 

u}£(MnKy 


[t \muk- ^]i 


where n,^ are positive integers. But, in our case M (Z K and therefore M f] K = M. 
Hence, 

[T^a,x\K ■'r] = [T \m- cr]. 

By |GW981 Theorem 8.1.3], K is multiplicity free in G, i.e. [n^^x : "t] < 1. The 
assertion follows. □ 


We pass now to X = r\X. We consider the locally homogeneous vector bundle 


Er := T\Er X. 


Let E^ be the flat vector bundle over X. We want to derive a trace formula for the 
heat operator e~^X,x_ By Lemma 2.4 and Proposition 2.5 in |Mulll] . e~^X,x is an 
integral operator with smooth kernel and of trace class. 

We can apply the Lidskii’s theorem, which gives a general expression for the trace 
of a trace class (not necessarily self-adjoint) operator in terms of its eigenvalues. By 
|Sim051 Theorem 3.7], 


Tre ^ (5.14) 

AjSspec(Af-,,^.) 

where m{Xj) is in the Dehnition 4.6. The kernel function of the integral operator 
e“*X,x is a smooth section of {Er ® E^) ® {Er 0 E^)*, i.e.. 

It can be expressed as 


Hl’^{x, y) = ^ HI (x, 7^ 0 x(7) Idy^, 
7er 


where x, y are lifts of x, y to X, respectively, and is the kernel of e 
By |Mulll( Proposition 4.1], we have the following proposition. 
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Proposition 5.3. Let be a flat vector bundle over X = r\X associated with 
a finite dimensional complex representation T —)■ GL(P^) ofT. Let be the 
twisted Bochner-Laplace operator acting on C°^{X, ® E^^). Then, 

AjGspec(A5-^^) 

= 5^trx(7)/ ^^Hl{g-^-^g)dg. (5.15) 

7er 

We proceed further to obtain a better version of the trace formula, analyzing the 
above identity in orbital integrals. We group together into the conjugacy classes [7] 
of r, and we write separately the conjugacy class of the identity element e to get 

Tr(e-*^"’^) = dim(K,) Vol(X) tr i7;(e) 

+ y] trx( 7) Vol(r^\G^) /" iiHl{g-^'yg)dg, (5.16) 

Yl\+e 

where and are the centralizers of 7 in F and G, respectively. 

We are interested in the zeta functions associated with a geodesic flow on the 
bundle E{a,x) ■= G (W ® Vy) —)■ S{X) as it is explained in section 3. Let 
R{M)^ and R{M)~ be the subspaces of the elements of R{M) that are invariant, 
respectively not invariant, under the action of the Weyl group IW4. More precisely, 
since the order of the Weyl group IW4 is Wo, there is an eigenspace decomposition 
of R{M) into R{M)~^ and R{M)~ . The subspaces R{M)^ correspond to the (±1)- 
eigenspaces, respectively. 

Proposition 5.4. 1. The map i* is a bijection between R{K) and R{M)~^ 

2. If a G R{M)~, then there exists a unique element r((j) G K, with highest 


weight = ((z/i - |)ei,..., (z/„ - |)e„) and z/„(a) > 0, 

such that ( 4 . 41 ), 

a — wa = (s^ — s“)F(r((T)), 

(5,17) 

where are the half spin representations of M. More precisely, if s is the 

spin representation of K, then T{a) ® s splits into 

T{a) <S) s = ® T (a) 

(5,18) 

such that 

a + wa = i*{T~^{a) — T~{a)), 

(5,19) 
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with 


(5.20) 


M6{0,1}" 
c(/i)=±l 

where c(/i) := jj{l G /i}, Tv^{a) is the representation of K with highest weight 
— fJ-! ^o- is given by (2.5). 

Proof. See |B095l Proposition 1.1]. □ 

Let To- G R{K) with To- := t+((t) — r“(cT). By Proposition 5.4, there exist unique 
integers mric) G { — 1,0,1}, which are equal to zero except for finitely many t E K, 
such that 

a ='^2mr{o')i*{T)-, (5-21) 

tGK 

Then, the locally homogeneous vector bundle E{a) associated with r is of the form 

E{a)= 0 E^, (5.22) 

tGK 

m.r(<y)^0 

where Et- is the locally homogeneous vector bundle associated with r E K. Therefore, 
the vector bundle E{a) has a grading E{a) = E{a)~^®E{a)~. This grading is defined 
exactly by the positive or negative sign of mr{cr). Let E{a) be the pullback of E{a) 
to X. Then, 

E(a)= 0 Er. 

T&k 

mr(o-)7^0 

We consider now the lift of the Bochner-Laplace operator associated to t E K 
to X, acting on smooth sections of Er. Recall equation (5.4): 

A, = -R{n) + Xrld. 


We put 


Ar := A,- — At Id . 


(5.23) 


Hence, by (5.4) the operator Aj- acts like —R(Q) on the space of smooth sections of 
Et-. It is an elliptic formally self-adjoint operator of second order. By |Che73] . it is 
an essentially self-adjoint operator. Its self-adjoint extension will be also denoted by 

It. 
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We use the flat Laplacian on the universal covering X. We get then the 
operator acting on the space C°°{X,Er ® E^). Since is induced by the 
operator it can be locally described as 

1“,^ = 4 ® Idy^ . (5.24) 


We pass to A = r\A. We put 


c(cr) := -|p|^ - + Wa + Pm\^, 


(5.25) 


where is the highest weight of a G M as in (2.5) and p, Pm are defined by (2.3) 
and (2.4), respectively. We define the operator A^((t) acting on C°°{X, E{a) ® E^) 
by 

•= 0 ^r,x + c(fr). (5.26) 

mr(CT)/0 


Obviously, A([,(cr) preserves the grading. It is an elliptic operator of order two. 
However, the situation is now different, because it is not a self-adjoint operator 
anymore. This property is carried by the operator 

We deal first with the corresponding heat semi-group generated by the operator 
Since is induced by A|^, it is an integral operator with smooth kernel. 
By Proposition 5.3, its trace is given by 


Tr(e-*^ 


tt 

'r,X 



irQUs 


(5.27) 


where QJ G (C'^(G) 0 End(K-))'^^^ is the kernel associated to the operator e 
We put 


Q? ='^mr{a)qj, (5.28) 

t&K 

K{t] a) = ^ mr{<j) ^(6“*"^*’^). (5.29) 

tGK 

We use now the trace formula from |Wal76( p.177-178], which expands (5.27). We 
have 


K{t; a) = dim(Hx) Vol(A)gf (e) 

1 ^(7)tr(x(7)) 

2^ ’^r(7)^(7) 


tr (T(m.y) 

a-eM 


0<x,A(gr)e-*'(^)"dA. 


(5.30) 
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We continue analysing the trace formula above in terms of characters. For the 
identity contribution we have 


(tf )(e) = E 

crSM 




(5.31) 


where denotes the Plancherel polynomial, dehned in section 2. By equation 

(5.28) we get 

0<7,A(gr) = (5.32) 

tGK 


By Proposition 5.2, 

0<,p(g[) = e-*(-"-^(''))[r|M:cr]. (5.33) 


The term A,- does not occur here, since our operator is induced by the operator 
Ar = Ar — Xr W. We recall also 


7ra,A(f^) = -A^ + c(cr). (5.34) 

This is proved in |Artl p.48]. 

Combining equations (5.32), (5.33) and (5.34) we get 

[t\m ■ cr]. (5.35) 

T&k 


Equivalently, for a, a' E M 


mr{(T)i*ir) : a' 


t&K 


Hence, by (5.21), 

(5.36) 

If we put everything together and insert (5.31), and (5.36) in (5.30), we obtain 


K{t] a) 


dim(Hx) Vol(X) 


P^{iX)dX 




/( 7 ) ^ ^ 

(47rf)V2 
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where 


^ tr(x( 7 ) ® a(m^))e 

det(Id — Ad(m^a^)n) 


(5.37) 


By the definition of the operator AE^((t) in (5.26), we get the following theorem. 
Theorem 5.5. For every a G M, 



where Lsymi'yicr) is as in (5.37). 

6 Meromorphic continuation of the zeta functions 

Let n be a closed linear operator, defined on a dense subspace of T){A) of a 
Hilbert space fit. Let a G C — spec(—A). We set R{a) := {A + ald)“^ = (A + a)“^. 
Then, the resolvent identity states 


R{a) - R{b) = {b- a)R{a)R{b), 


for all a, 6 G C — spec(—A). The generalized resolvent identity is described in the 
following lemma. 

Lemma 6.1. Let Si, ..., sat G C — spec(— U), G N, such that Si ^ Sj for all i ^ j. 
Then, 



Proof. This is proved in |B095( Lemma 3.5]. 


□ 


We will use also the following lemmata. 

Lemma 6.2. Let si,... ,sn & C, N E N, such that Si ^ Sj for all i ^ j and let 
/ = 0,1,..., — 2. Then, we have 



( 6 . 2 ) 
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Proof. This follows from |B0951 Lemma 3.6], applied to □ 

Lemma 6.3. Let si,..., sat G C, iV G N, such that Si 7 ^ sj for all i ^ j ■ Then, 



(6.3) 


as 


t 0 +. 


Proof. We will use the Taylor expansion of the exponential function e 
We have as t —)■ 0+ 


N / N 


i=i h 


_ fq 

e » = 




EE 

k=l j=l 


..2k 


k\ 


N 

n 


k\ 

k=l 2=1 


§2 - §2 

, = 1 
N 


+ 0{t 


N-l\ 


\k - / ^' ^ 


E“2 /_,\k ^ 

E nf E *.“ (n ^) + Of*"-') = op")’ 




where in the last equality we used Lemma 6.2. □ 

Lemma 6.4. Let si G C such that Re(s^) > 0 for all i = 1,... ,N. Then, the 
following integral 

fOO f N 1 \ 

/ J2il\ -2 - 2 ) (6.4) 

Jo ^kJ 

j¥=k 

converges absolutely. 

Proof. We have as t —)■ cxd, 



e-d*i+P)p^(^A) 


dX = 0(e-‘") 


(6.5) 


for some e > 0. 

We use now the fact the P{iX) is an even polynomial of degree 2n f |Mia791 264-265]). 
If we make a change of variables A' h-)■ Xy/i, we get as t —?■ O’*", 


e-*^>,(iA) dX = 0{t-^/^). 


( 6 . 6 ) 
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Hence, if we combine (6.3) and (6.6) we have that as t —)■ O’*", 





d\ = 0(t-'^/2+v-i^_ 


The assertion follows from (6.5) and (6.7). 


(6.7) 

□ 


Let N E N. Let Si,i = be complex numbers such that Sj G C — 

spec(— H^((t)). We consider the resolvent operator R{sj) = (A^(o-) + s^)“^. We want 
to obtain the trace class property of the operator order to obtain this 

property, we take sufficient large N eN, such that for iV > |, 

N 

Tr(jj7?(s-)) < oo. (6.8) 

i=l 

We denote the space of pseudodifferential operators of order k by -ipDO'^. To prove 
the trace class property of the operators above, we observe at hrst that nf=i Ris^) e 

Let A be the Bochner-Laplace operator with respect to some metric, acting on 
C°^{X, E-r^ (8) E^). Then, A is a second-order elliptic differential operator, which is 
formally self-adjoint and non-negative, i.e., A > 0. Then, by Weyl’s law, we have that 
for A > |, (A-|-Id)“^ is a trace class operator. Moreover, B := (A-|-Id)^ Ilili Ri^f) 
is 'ipDO of order zero. Hence, it dehnes a bounded operator in L‘^{X, T^rs(( 7 ) ® Ex)- 
Thus, n^i Ri^l) = (A -|- Id)“^i? is a trace class operator. 

We recall here the following expressions of the resolvents. Let si,... ,sn G C 
such that Re(sf) > —c, for all f = 1,..., A, where c is a real number such that 
spec (HE^((t)) C {z E C-. Re( 2 ;) > c}. Then, 



Let A G N with A > d/2. Let si,..., sat G C with Si ^ Sj for all i ^ j such that 
Re(s^) > —C, for alH = 1,..., A, where C* is a real number such that spec (^)) c 
{z E C: Re(z) > C}. 

By Lemma 6.1 and equation (6.9), we get 
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Then, 


N 


Trn(^i(c^) + 5?) 


2\-l 


i=l 


N 

E 

2=1 


N 

n? 

,.i 


— -s- 






We insert now the right-hand side of the trace formula (5.38) for the operator 
and get 


N 


2=1 


I 


N . N 

Efn 


— g2 

i=l \ j=l ** 

3+i 




I 


r i(^) e-h7)V{4t) 'I 

dim(f4) Vol(X) y e P„{iX)dX + ^ 


Hence, 

N 


jv ^oo r ^ ^ 1 \ 

Tr n(4(a) + s2)-i = dim(Hj Vol(X) / / V IT ^- 2 P^{iX)dXdt 

i=i Jo Jr V Sj -sj 

j¥=i 


N 


E/ n 


i=l -^0 


AT 


- s2 

J=1 


^-tsj 








«r(7)' 


(47rt)^/2 

( 6 . 10 ) 


dt. 


The first sum in the right-hand side of (6.10), which involves the double integral can 
be explicitly calculated. We set 


I : = 


N . N 

E(n 


- s2 

i=l 7j=l J ** 
JT^i 


e-i**e-'^'P^(fA)dAdt. 


By Lemma 6.4, we can interchange the order of the integration and get 


/ = 



00 N ^ N ^ 


0 i=i \ j=i 


E(n 

i=i 
j¥=i 
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By |BQ95l Lemma 3.5] and since is an even polynomial, we obtain the following 
convergent integral 


I 




Pa{iX)d\. 


Using the Canchy integral formula we have 


N . N . 

^=E (n 


( 6 . 11 ) 


For the second sum in the right-hand side of (6.10) we use the formula (see lEMOTS"^ 
P-146,(27)1) 


“ 2 p-ipYK^t) 


df = _p-^h7) 

[AirtyP 2s 


( 6 . 12 ) 


Hence, equation (6.10) becomes by (6.11) and (6.12) 

N N , N ^ 


Trn( 4 (^)+^') '= 5 ^ n 


2 = 1 


TT 


. sf — s? / s. 

i=l 7j=l ] 

j¥=i 


- dim(Ux) Vol(X)P(si) 


" 1 /A 1 


EP(n 

1=1 
j¥=i 


2=1 


- s 2 

1=1 


(6.13) 


By Lemma 3.6, the sum over the conjugacy classes [ 7 ] of F in the right-hand side of 
(6.13) is equal to the logarithmic derivative L{si) = ■^\og{Z{si;a,x) of the Selberg 
zeta function. Hence, 


N 

2=1 


N . N . 

E n 7 Vol(V)P(i>.) 

i=iVj=iP 



(6.14) 


In the Theorem 6.5 below, we choose the branch of the square roots of the complex 
numbers tk, whose real part is positive. In addition, if tj. are negative real numbers, 
we choose the branch of the square roots, whose imaginary part is positive. 
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Theorem 6.5. The Selberg zeta function Z(s; a, x) admits a meromorphic continua¬ 
tion to the whole complex plane C. The set of the singularities eguals = ±i^/tk : 
tk G spec(A^((T)),/c G N}. The orders of the singularities are egual to m(tk), where 
m{tk) G N denotes the algebraic multiplicity of the eigenvalue tk- For to = 0, the 
order of the singularity sq is egual to 2m(0). 

Proof. By (6.1) and (6.14) we get 


N / N 


N / N 


Tr E ( n ) (4(^) + -*)" = E ( n Vol(X)P(.. 

i=l j * / i=i ^ j=l i * / * 




N 


5 :i(n 


N 


- s2 


L{s,). 


Equivalently, 


N / N 


jp* 


N / N 


E n 


j ,-dim(V')Vol(X)P(s,) 

Sz Sz j Si 


i=i \i=i P 
JT^i 

N / N 


EE(n?^^ 

4 i=l ^ i=l ■?' * 


Si - sf J tk + s: 


2 ’ 


(6.15) 


If we multiply equation (6.15) by 2si, we obtain 




7rdim(I4) Vol(X)P(si) 


mjtk) 
tk + sj 


(6.16) 


Let P(si,..., stv) be the function of the complex numbers si,..., sat, dehned by 

N / N 


p(si,...,sjv)—E n 


1 


• 1 \ ■ i ~ ^ ^ 

2=1 ^ j = \ J 


-L{s,). 
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We fix the complex numbers Si,i = 2,. .., N with Sj 7 ^ Sj for i,j = 2,. .., N and let 
the complex number s = Si vary. 

Put 

...,S7v) =!^(s). 

Then, equation (6.16) becomes 

N . N . 

=~J2( n .,2 _ ^2 )^ 7 rdim(\ 4 ) Vol(X)P(g^) 

1 V • 1 

2=1 ^ J = 1 J * ^ 

N / N . . 


s2 _ 2 , 2’ 

ife i=l ^j=l J + 


(6.17) 


where Si = s. The term that contains the logarithmic derivative L{s) in ^{s) is of 
the form 


N 

n 

i=2 


s? — 


L{s). 


The term of 


N / N 




m(tk 




which is singular at k eN is 


N 


We multiply both sides of the equality (6.17) by 


N 

n( 

J=2 


2 2 \ 
- O 


Then, the residues of L{s) at the points ±i\/tk are m(tk), for k ^ 0, and 2m(0) for 
k = 0. 

By (3.20), L{s) decreases exponentially as Re(s) —)■ 00 . Hence, the integral 

L{w)dw 
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over a path connecting s and infinity is well defined and 


\ogZ{s;a,x) = - j L{w)dw. (6.18) 

The integral above depends on the choice of the path, because L{s) has singularities. 
Since the residues of the singularities are integers, it follows that the exponential of 
the integral in the right-hand side of (6.18) is independent of the choice of the path. 
The meromorphic continuation of the Selberg zeta function Z{s]a,x) to the whole 
complex plane follows. 

□ 

In view of the previous results, we will use the meromorphic continuation of the 
Selberg zeta function to obtain the meromorphic continuation of the Ruelle zeta 
function to the whole complex plane C . 

Following the analysis in |BQ951 p. 93-94], we consider the identification = 
C 3 A. Let a > 0 be the unique positive root of the system (g, a). Let A: ^4 —)■ 
be the character, defined by A (a) = 

Let Uc be the complexification of the Lie algebra n. Let Up := Ad„^{MA) be 
the representation of MA in given by the p-th exterior power of the adjoint 

representation: 


Up := Adnj,: MA —)■ GL(A^nc), p = 0,1,..., d — 1. 

For p = 0,1,..., d — 1, let Jp C {(V^p, A): -^p G M, A G C} be the subset consisting of 
all pairs of unitary irreducible representations of M and one dimensional represen¬ 
tations of A such that, as MA-modules, the representations Vp decompose as 

A^Uc = ® Ca, 

('f/jp,A)G Jp 

where Ca = C denotes the representation space of A. 

For (j G M we define 

Zp{s]a,x)-= n Z{s + p - \]'il)p®a,x)- (6-19) 

('f/jp,A)GJp 

We have then the following theorem, which gives a representation of i?(s; a, x) as a 
product of Zp{s; a, x) over p. 
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Theorem 6.6. Let a G M. Then the Ruelle zeta function has the representation 


d-l 


R{s]a,x) = YlZp{s]a,x)^ 

p=0 


( 6 . 20 ) 


Proof. By (3.14), we have 

\ogZ{s + p - \;fjp(g)a,x) 

We use now the fact that 


E 


^r(7) 


tr(x(7) O a(m^)) 


g( s '^P+^)h'r) iY{^ijjp(^m)) 
det(l — Ad{m^a^)\n) 
( 6 . 21 ) 


det(l — Ad(m.ya.y)|^Y) = (—1)'^ ^a..^^^det(l — Ad(m.ya^)|n). (6.22) 

Hence, if we insert (6.22) in (6.21), we get 


\ogZ{s + p-\]'ipp<S)(T,x) 


We have 


(-^E 


1 

^r(7) 


tr(x(7)(g)a(m^)) 


e ^h7)g>‘h7) tr('^p(m)) 
det(l — Ad(m.ya.y)|n) 


(6.23) 


d-l 


d-l 


log JjEp(s;a,x)( ^1'’ = ^ log Ep(s; a, x)l 


_i)p 


p=0 


p=0 


d-l 


(-1)^ logZp(s;a, x) 


p=0 

d-l 


^(-l)Plog Yl Z{s + p- X-,ijp(^a,x) 

p=o (i/)p,A)eJp 

d—1 / 

Y log+ d-® 


p=0 

d-l 




P =0 ^ 

E(v,p,A)eJp tr(^p(m)) 
det(l — Ad(m.ya.y)|n) 


nvin) 


tr(x( 7 ) (g) a{ni^))e 


(6.24) 


38 



where in the third line we used the dehnition (6.19), and in the last line, equation 
(6.23). We recall now the that for any endomorphism of a hnite dimensional vector 
space W, we have 

CXD 

det(Idvc-W") = 5^(-l)^tr(AW). 

p=0 

If we apply this identity to A.d{m^a^)\n we get 


d-l 




p=0 


det(l — Ad(m^a.y)n) 


Hence, by (6.24) we have 

d-l 

log JJ^p(s;a,x) 

p=0 


(-1A _ 


(-itE 


= log/?(s;a,x). 


nr ( 7 ) 


tr(x( 7 ) (E) cT(my))e *^1^1 


where in the last line we used by equation (3.17) in the proof of Proposition 3.5. □ 

Theorem 6.7. For every a G M, the Ruelle zeta function i?(s; a, x) admits a mero- 
morphic continuation to the whole complex plane C. 

Proof. The assertion follows from Theorem 6.5 together with Theorem 6.6. □ 
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